| Name | Version | Summary | date |
| ai-edge-quantizer-nightly |
0.0.1.dev20250130 |
A quantizer for advanced developers to quantize converted AI Edge models. |
2025-01-30 00:11:23 |
| gptqmodel |
1.7.4 |
A LLM quantization package with user-friendly apis. Based on GPTQ algorithm. |
2025-01-26 07:26:05 |
| bitsandbytes |
0.45.1 |
k-bit optimizers and matrix multiplication routines. |
2025-01-23 16:34:33 |
| autoawq |
0.2.8 |
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. |
2025-01-20 11:03:42 |
| llmcompressor |
0.4.0 |
A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation. |
2025-01-16 03:07:54 |
| llmcompressor-nightly |
0.4.0.20250115 |
A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation. |
2025-01-15 20:10:48 |
| fedcore |
0.0.5.0 |
Federated learning core library |
2025-01-12 23:11:47 |
| friendli-model-optimizer |
0.10.0 |
Model Optimizer CLI for Friendli Engine. |
2025-01-08 09:57:35 |
| vector-quantize-pytorch |
1.21.1 |
Vector Quantization - Pytorch |
2025-01-07 16:20:55 |
| fmo-core |
0.9 |
Model Optimizer for Friendli Engine. |
2025-01-03 08:40:30 |
| nncf |
2.14.1 |
Neural Networks Compression Framework |
2024-12-19 12:29:25 |
| optimum-intel |
1.21.0 |
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework to integrate third-party libraries from Hardware Partners and interface with their specific functionality. |
2024-12-06 12:25:14 |
| autoawq-kernels |
0.0.9 |
AutoAWQ Kernels implements the AWQ kernels. |
2024-11-16 15:42:59 |
| optimum |
1.23.3 |
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework to integrate third-party libraries from Hardware Partners and interface with their specific functionality. |
2024-10-29 17:43:32 |
| optimum-quanto |
0.2.6 |
A pytorch quantization backend for optimum. |
2024-10-29 17:13:31 |
| owlite |
0.0.8 |
A fake package to warn the user they are not installing the correct package. |
2024-10-02 07:36:45 |
| hquant |
0.1.0 |
High quality quantization for Pillow images. |
2024-09-19 23:02:03 |
| bitlinear-pytorch |
0.5.0 |
Implementation of the BitLinear layer from: The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits |
2024-09-11 15:26:31 |
| awq-cli |
0.2.0 |
Command-line interface for AutoAWQ |
2024-08-09 08:02:27 |
| optimum-benchmark |
0.4.0 |
Optimum-Benchmark is a unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes. |
2024-07-31 08:35:53 |